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AM  ALGORITHM  FOR  RESCALING  A  MATRIX  POSITIVE  DEFINITE 

Hul  Hu 

Abstract 

For  a  given  square  real  matrix  M,  we  present  a  general  algorithm 
which  decides  the  existence  of  a  positive  diagonal  matrix  D  such  that 
DM  is  positive  definite  and  which  constructs  the  D  if  it  exists.  It 
is  shown  that  solving  this  matrix  rescaling  problem  is  equivalent  to 
finding  a  solution  of  an  infinite  system  of  linear  inequalities.  The 
algorithm  solves  the  Infinite  system  of  linear  inequalities  by 
generating  and  solving  a  sequence  of  linear  programs. 

1 .  Introduction 

Given  a  square  real  matrix  M,  does  there  exist  a  positive  diagonal 
matrix  D  such  that  DM  is  positive  definite?  If  such  a  D  exists, 
how  can  it  be  constructed?  Such  questions  arise  in  mathematical 
economics  and  in  the  study  of  certain  engineering  systems  [1].  A 
necessary  and  sufficient  condition  for  the  existence  of  such  D  for 
3*3  matrices  was  given  by  Cross  [4].  The  existence  of  such  D  for 
Leontief  matrices  was  proved  by  Tartar  (12]  and  Dantzig  (5j.  A  general 
necessary  and  sufficient  condition  for  the  existence  of  such  D  was 
given  by  Barker,  Berman  and  Plemmons  [1].  However,  the  condition  is 
difficult  to  verify  in  practice.  Methods  for  constructing  such  D  for 
some  special  classes  of  matrices  were  discussed  in  [1]  and  [2]. 


In  this  paper  we  present  a  general  algorithm  which  decides  the 


existence  of  such  D  and  which  constructs  such  a  D  if  it  exists.  In 
Section  2  we  explain  notation  and  preliminaries.  In  Section  3  we 
specify  the  algorithm,  prove  its  correctness  and  convergence,  and 
discuss  conditions  that  guarantee  termination  in  a  finite  number  of 
steps.  Computational  results  are  presented  in  Section  4.  Finally,  we 
discuss  possible  ways  to  accelerate  the  convergence  in  Section  5. 


2.  Notation  and  Preliminaries 

An  n  x  n  real  matrix  M,  not  necessarily  symmetric ,  is  positive 
definite  if  xTMx  >  0  for  all  0  ^  x  f  Rn. 

If  there  exists  a  positive  diagonal  matrix  D  such  that  DM  is 
positive  definite,  we  say  that  M  can  be  rescaled  positive  definite. 
Such  matrices  are  called  "diagonally  stable”  in  [1]  and 
"Volterra-Lyapunov  stable"  in  [4]. 

Superscripts  on  vectors  are  used  to  denote  different  vectors,  while 
subscripts  are  used  to  denote  different  components  of  a  vector. 

Let  S  "  (x  e  R°:  x^x  -  l}  denote  the  unit  sphere  in  Rn  and 
=  {x  e  Sn  1 :  x  0}  denote  the  set  of  nonnegative  vectors  in  S°  * 
D( x )  is  a  diagonal  matrix  with  diagonal  elements  x^  for 
i  =  1,  ...  ,  n. 

For  a  real  symmetric  matrix  B,  let  \[B]  stand  for  the  smallest 
eigenvalue  of  B  and  V [ B]  a  corresponding  eigenvector  of  unit  length. 


Given  a  mathematical  programming  problem  (P),  v(P)  denotes  the 


optimal  objective  function  value  of  (P). 


Let  e*  be  the  i-th  unit  vector  of  R°  and  e=e^+**»+  e°. 


conv(S)  denotes  the  convex  hull  of  S. 

B x B  denotes  the  Euclidean  norm  of  x. 

T 

Fact  1 .  M  is  positive  definite  if  and  only  if  M  +  M  is 
positive  definite. 

T 

Fact  2.  M  is  positive  definite  if  and  only  if  x  Mx  >  0  for  all 

_n-l  ,  _n-l  ,  n  T  , , 

x  €  S  ,  where  S  ={xeR:xx=l}. 

Fact  3.  All  principal  minors  of  M  remain  sign  invariant  under  a 

positive  rescaling  DM. 

Fact  4.  If  M  is  positive  definite,  then  all  its  principal  minors 
are  positive  (see,  e.g.,  Cottle  [3]). 

T 

Fact  5.  If  M  is  positive  definite,  then  B  MB  is  positive 
definite  for  any  real  nonsingular  matrix  B. 

Fact  6.  For  any  real  symmetric  matrix  B, 

\[B]  =  min  {uTBu:  u  e  S°  (see,  e.g.,  Wilkinson  [13],  p.  98-99). 

Fact  7 .  For  any  real  symmetric  matrix  B,  X [ B]  is  a  continuous 
function  of  the  elements  of  B  (see,  e.g.,  Isaacson  and  Keller  [9], 
p.  136). 

Remark  1. 

(1)  Let  DM  (MD)  be  a  positive  rescaling  of  the  rows  (columns)  of 

the  matrix  M.  M  can  be  column-rescaled  positive  definite  if  and  only 

if  M  can  be  row-rescaled  positive  definite.  Indeed,  if  DM  is 

positive  definite,  where  D  is  a  positive  diagonal  matrix,  then 
-IT  - 1  - 1 

(D  )  DMD  =  MD  is  also  positive  definite  (Fact  3)  and  vice  versa. 

(2)  We  are  only  interested  in  rescaling  nonsymmetric  matrices 
because  if  a  real  symmetric  matrix  is  not  positive  definite,  then  it  can 


not  be  rescaled  positive  definite.  For  given  a  real  symmetric  matrix 


M,  if  all  its  principal  minors  are  positive,  then  M  is  positive 
definite.  Otherwise,  at  least  one  of  the  principal  minors  of  M  is  not 
positive.  Therefore,  DM  has  at  least  one  nonpositive  principal  minor 
for  any  positive  diagonal  matrix  D  (Fact  3)  and  DM  is  not  positive 
definite  (Fact  4). 

(3)  If  M  can  be  rescaled  positive  definite,  then  it  is  easy  to 
see  that  M  is  nonsingular  and  the  diagonal  elements  of  M  are 
positive  (by  Fact  4,  d^m^  >  0  for  all  i,  which  implies  >  0  for 

all  i).  Therefore,  without  loss  of  generality  we  assume  that  the 
matrix  M  to  be  rescaled  is  nonsingular  and  has  only  positive  diagonal 
elements . 


3.  The  Algorithm  and  its  Convergence 

First  we  show  that  solving  the  matrix  rescaling  problem  is 
equivalent  to  finding  a  solution  of  an  infinite  system  of  linear 
inequalities. 


Theorem  1.  Suppose  that  all  diagonal  elements  of  matrix  M  =  (m^)  are 


positive.  Then  M  can  be  rescaled  positive  definite  if  and  only  if  the 
following  infinite  system  of  linear  inequalities 


(ISLI):  (D(u)Mu)Tx  >  1  for  all  u  e  s"'1 


has  a  solution.  Moreover,  for  any  x  solving  (ISLI),  D(x)  rescales 


M  positive  definite 


Proof.  If  there  exists  a  positive  diagonal  matrix  D(d)  such  that 

T 

D(d)M  is  positive  definite,  let  f(u)  =  u  D(d)Mu.  f(u)  is  a  continuous 
function  of  u  and  S0  ^  is  a  compact  set.  Hence,  f(u)  achieves  its 
infimum  on  Sn  * ,  i.e.,  there  exists  u  e  Sn  *  such  that  f(u)  ^  f(u)  >  0 
for  all  u  e  Sn  Let  x^  =  d^/f(u)  for  i  =  1,  ...»  n,  we  have 

rp  rp  1 

(D(u)Mu)  x  =  u  D(d)Mu/f(u)  =  f(u)/f(u)  _>  1  for  all  u  e  S  .  Thus, 
(ISLI)  has  a  solution.  On  the  other  hand,  if  x  is  a  solution  of 

T>  rp  r»  —  1 

(ISLI),  then  we  have  u  D(x)Mu  =  (D(u)Mu)  x  ^  1  >  0  for  all  u  e  S 
By  Fact  2,  D(x)M  is  positive  definite.  To  complete  the  proof,  we 
only  need  to  show  that  x^  >  0  for  all  i  =  1,  ...  ,  n.  Indeed, 
(ei)TD(x)Mei  =  m^x^  >  0  for  all  i  =  1,  ...  ,  n  since  e^  e  s"1 
also,  all  m  are  positive  by  assumption.  Consequently,  all  x 
are  positive.  G 

Theorem  1  tells  us  that  M  can  be  rescaled  positive  definite  if 
and  only  if  (ISLI)  has  a  solution;  and  moreover,  for  any  x  solving 
(ISLI),  D(x)  rescales  M  positive  definite.  The  algorithm  we  are 
going  to  present  is  actually  to  decide  whether  (ISLI)  has  a  solution 
or  not  and  to  find  such  a  solution  if  it  exists. 

It  is  well  known  that  deciding  whether  a  finite  system  of  linear 
inequalities  has  a  solution  is  equivalent  to  solving  a  linear  program 
(see,  e.g.,  Dantzig  [6],  Chapter  5).  In  an  analogous  way,  to  solve  the 
infinite  system  of  linear  inequalities  (ISLI),  we  solve  (DILP)  —  the 
dual  of  the  infinite  linear  program  ( ILP)  (see,  e.g.,  Duffin,  .Teroslow 
and  Karlovitz  [8]). 


( ILP ) : 


minimize  x,  +  x„  +  •••  +  x 
12  n 


subject  to 

(D(u)Mu)^x  >  1  for  all  u  e  Sn  * 


(DILP):  maximize  )>  y 

ieA  1 

subject  to 

'i  D(u^)Mu^y  =  e 
ieA  1 

y^  >_  0  for  all  ieA 

A  is  finite  and  (uS  i  e  A}  c  sn  * 

This  column  generating  algorithm  is  the  analogue  of  a  cutting  plane 
algorithm  applied  to  (ILP).  It  generates  and  solves  a  sequence  of 
linear  programs  (LP(k))  for  k  =  1,  2,  ...  .  If  v(LP(k))  tends  to 
infinity,  then  M  can  not  be  rescaled  positive  definite  (Theorem  3). 
Otherwise,  a  positive  vector  x  which  rescales  M  positive  definite 
will  be  found  after  finitely  many  iterations  (Theorem  2). 

We  assume  that  the  input  matrix  M  is  nonsingular  and  has  only 
positive  diagonal  elements  (Remark  1). 

Algorithm. 

Step  1. 

Let  k:  =0; 


let  (LP(k))  be  the  following  linear  program: 


maximize  ^  y 
i-1 

subject  to 


l  D(ei)Me1y  =  e 
i  =  l 

y^  ^  0  for  i  =  1,  . ..,  n 
let  e  <  1  be  a  small  positive  number  (e.g.,  e 


% 


a 


icf6) , 


Step  2. 

Let  x  be  an  optimal  dual  solution  of  (LP(k)); 

find  a  Xk  satisfying  |Xk  -  X[D(xk)M  +  MTD(xk)]|  <  ( 1 / 2 ) e ; 

if  Xk  >  (l/2)e,  go  to  Step  4. 

Step  3. 

Find  a  vector  uk+*  e  Sn  ^  such  that 

Buk+1  -  V[D(xk)M  +  MTD(xk))S  <  e  and  (uk+1 )TD(xk)Muk+1  <  e; 

1  1 

form  (LP(k+l))  by  adjoining  the  column,  D(u  )Mu  ,  to  the 
constraint  matrix  of  (LP(k))  with  cost  coefficient  1; 
solve  (LP(k+l)); 

if  v(LP(k+l ))  =  ®,  then  go  to  Step  5; 
else  k:  =  k  +  1,  go  to  Step  2. 


I 

4 


i 


Step  4, 

D(x  )M  is  positive  definite,  stop. 

Step  5. 

M  can  not  be  rescaled  positive  definite,  stop. 

P 

I 


7 


Comments  on  the  algorithm. 

(1)  Since  we  assume  m^  >  0  for  all  i  -  1,  ...  ,  n,  (LP(0))  is 
feasible.  Therefore,  (LP(k))  is  feasible  for  all  k. 

(2)  Efficient  algorithms  for  calculating  eigenvalues  and 
eigenvectors  of  a  matrix  are  discussed  in  Wilkinson  [13]. 

(3)  A  symmetric  matrix  B  is  positive  definite  if  and  only  if 
MB]  >  0;  in  general  this  is  not  true  for  nonsymmetric  matrices. 

Therefore,  we  calculate  the  smallest  eigenvalue  of  the  symmetric  matrix 

k  T  k  k 

D(x  )M  +  M  D(x  )  in  order  to  know  whether  D(x  )M  is  positive  definite 

(Fact  1). 

(4)  If  the  algorithm  does  not  stop  at  an  iteration  k,  then  it 

k+ 1  k+ 1  k+ 1  T  k 

generates  u  satisfying  (D(u  )Mu  )  x  <  e  <  1.  While 

i  i  T  k  k 

(D(u  )Mu  )  x  >M  for  all  i  *  0,  1,  ...  ,  k  since  x  is  an  optimal 

k.  k 

dual  solution  of  LP(k).  Therefore,  no  column  D(u  )Mu  can  be  brought 
in  more  than  once. 

Next,  we  prove  the  correctness  and  convergence  of  the  algorithm  and 
discuss  conditions  that  guarantee  termination  in  a  finite  number  of 
iterations . 

Theorem  2.  If  there  exists  a  positive  diagonal  matrix  D  such  that  DM 
is  positive  definite,  then  the  algorithm  can  find  such  a  D  after 
finitely  many  Iterations. 


Proof.  If  M  can  be  rescaled  positive  definite,  then  the  corresponding 
program  (ILP)  is  feasible  by  Theorem  1.  Let  x  be  a  feasible  solution 
of  (ILP).  Then,  for  all  feasible  solutions  of  (DILP),  we  have: 

l  y.  <  I  y  (D(ui)Mui)Tx  =  eTx. 
ieA  1  ieA  1 

Namely,  the  objective  function  of  (DILP)  is  bounded  from  above  by 

e  x.  The  algorithm  generates  a  sequence  of  linear  programs  (LP(k)), 

k  =  0,  1,  ...  .  Each  (LP(k))  is  feasible  and  is  the  restriction  of 

(DILP)  to  certain  columns.  Hence,  the  objective  function  of  (LP(k)) 

T- 

is  also  bounded  from  above  by  ex.  By  the  duality  theory  of  linear 
programming,  we  can  find  an  optimal  dual  solution  x  of  (LP(k)) 
which  satisfies 

0  <  (m^)  <  x^  <  e  x  £  e  x  for  all  i  =  1,  ...  ,  n. 

Let  T={x€Rn:0£xi'<  eTx  for  all  i  =  1,  ...  ,  n}  and 

F(x,u)  =  (D(u)Mu)Tx.  Then  F(x,u)  is  uniformly  continuous  on  T  *  SD  * , 

i.e.,  for  any  6  >  0,  there  exists  r|  >  0  such  that 

(a)  H(x,u)  -  (x,u)ll  <  r)  implies  |F(x,u)  -  F(x,u)|  <  6  for  all 
(x,u)  and  (x,u)  in  T  x  sn 

In  particular,  for  6  =  1  -  e  >  0,  there  exists  iq  >  0  such  that  (a) 

k.  n- 1 

holds.  If  the  algorithm  goes  on  infinitely,  then  it  generates  u  e  S 
for  k  =  0,  1,  ...  .  Because  Sn  ^  is  compact,  for  the  h  >  0,  there 
exists  u*  and  in  the  sequence  satisfying  Hu*  -  II  <  q. 


Without  loss  of  generality,  we  assume  that  i  <  j.  Because  the 
algorithm  does  not  stop  at  iteration  j-1,  we  have: 

(b)  Ffx^.u1)  =  (D(u1)Mui)Tx:)"1  >  1; 

(c)  F(xj-1,uj)  =  (D(uj)Muj)Txj_1  <  E. 

However,  (b)  and  (c)  imply  that  |F(x^  \u*)  -  F(x^  ^  ,u^ )  |  >  1  -  e  =  6 
while  II  (x^  *  ,u*)  -  (x^  *  ,u^  )  It  <  ti,  which  contradicts  the  uniform 
continuity  of  F(x,u)  on  T  x  Sn  ^ .  It  follows  that  the  algorithm  must 
be  finite  in  the  case  M  can  be  rescaled  positive  definite.  □ 

Remark  2.  We  have  proved  the  finiteness  of  the  algorithm  under  the 

assumption  that  M  can  be  rescaled  positive  definite.  In  fact,  the 

T  k 

boundedness  of  v(LP(k))  =  e  x  for  k  =  1,  2,  ...  is  the  only 
assumption  we  need  for  the  proof.  Since  the  feasible  region  of  (LP(k)) 
can  be  considered  as  a  subset  of  the  feasible  region  of  (LP(k+l)),  we 
have  v(LP(k+l))  _>  v(LP(k))  for  all  k.  Therefore,  in  the  case  M  can 
not  be  rescaled  positive  definite,  the  algorithm  generates  a  sequence  of 
feasible  solutions  of  (DILP)  whose  objective  function  values  tend 
increasingly  to  infinity.  Hence,  the  following  theorem  is  established. 

Theorem  3.  The  following  are  equivalent: 

(1)  M  can  not  be  rescaled  positive  definite; 

(2)  v(DILP)  =  »; 

(3)  v(LP(k))  tends  to  infinity  as  k  □ 


1" 


We  have  seen  that  the  algorithm  is  finite  in  the  case  M  can  be 
rescaled  positive  definite.  Next,  we  give  a  condition  which  ensures  the 
finiteness  of  the  algorithm  in  the  case  M  can  not  be  rescaled  positive 
definite,  i.e.,  there  exists  j  such  that  v(LP(j))  = 

Condition  1.  For  every  nonnegative  and  nonzero  diagonal  matrix  D, 
there  exists  u  e  Sn  *  such  that  u^DMu  <  0.  Equivalently,  there  does 
not  exist  nonnegative  and  nonzero  diagonal  matrix  D  such  that  DM  is 
positive  semidef inite. 

Theorem  4.  If  M  satisfies  Condition  1,  then  the  algorithm  stops  after 
finitely  many  iterations. 

Proof.  Define  G(x)  =  minimize  uTd(x)Mu  -  M(D(x)M  +  MTD(X))/2]  (Fact  6) 

xeS  1 

It  follows  from  Fact  7  that  G(x)  is  a  continuous  function  of  x. 

Since  M  satisfies  Condition  1,  we  have  G(x)  <  0  for  all  x  c  1 , 
where  s”  1  =  (x  c  S°  * :  x  ^  0).  Therefore, 

T 

(3  =  maximize  G(x)  =  maximize  minimize  u  D(x)Mu  <  0. 

«cn~T  „*cn-1  ...cn_T 

Let  F(x,u)  =  (D(u)Mu)Tx  =  u^D(x)Mu.  For  6  »  — ( 1/ 2 ) P  >  0,  there  exists 
D  >  0  such  that 

(d)  B(x,u)  -  (x,u)B  <  T|  implies  |F(x,u)  -  F(x,u)j  <  6  for  all 


As  indicated  in  the  proof  of  Theorem  2,  if  the  algorithm  goes  on 
infinitely,  it  generates  u*  and  u"^  (i  <  j)  satisfying  lu*  -  u^  I  <  t) 
and  F(x^  *,u*)  1.  Thus, 

(e)  F(x3“1/IxJ"1I,u1)  >  l/lxj_1l  >  0. 

Let  w  =  V[D(xJ-1)M  +  MTD(xJ_1)]  -  V[  (D(xJ_1  /  »xJ_1 1  )M  +  M^x^-1  /  lxj_1  II  ) 
and  assume  that  e  <  ti,  where  the  e  is  specified  in  Step  1  of  the 
algorithm.  Then,  lu^  -  wl  <  e  <  T)  (Step  3)  and  hence  we  have 
|F(x^  */!x^  ^l,u^)  -  F(x^  Vlx^  *l,w)|  <  6  *  -(1/2)0  by  the  uniform 
continuity  of  F(x,u)  on  s"  *  *  S°  * .  Thus, 

(f)  F(x^  V*x^  ^  ,uJ) 

<  -(l/2)p  +  wTD(xj"1/lxj_1I )Mw 

=  -(1/2)0  +  (l/2)wT(D(x:1-1/«x:1"ll)M  +  MTD(xj"1/lxj'1«))w 

=  -(1/2)0  +  X[(D(xJ-1/«xJ-1l)M  +  MTD(xj_1/Bxj‘1l))/2] 

=  -(1/2)0  +  G(xJ"1/lxj“1«) 

<  -(1/2)0  +  0 

=  (1/2)0. 

However,  (e)  and  (f)  imply  that 

|F(xJ"l/l*J“ll,u1)  -  F(xj~1/»xj"1fl,uJ)|  >  -(1/2)0  -  6  while 
II  (x-*  Vllx^  ,u*)  -  (x^  Vnx^  X1  ,«J)I  =  lu^  -  U^l  <  T), 

which  contradicts  the  uniform  continuity  of  F(x,u)  on  S^  1  *  Sn  ^ . 
Therefore,  if  M  satisfies  Condition  1,  then  the  algorithm  terminates 
after  finitely  many  iterations  (assume  that  €  <  h  ).  0 


In  the  rest  of  this  section,  we  discuss  other  necessary  and 
sufficient  conditions  for  M  to  be  rescaled  positive  definite  and 
equivalent  statements  of  Condition  1.  First,  we  state  a  theorem  that  we 
are  going  to  use  in  the  following  discussion. 

Alternative  Theorem.  Let  T  be  a  set  (T  may  be  infinite),  h^(t)  for 

1=1,  ...  ,n  be  real-valued  functions  on  T,  and 

P  =  {(h  (t),  ...  ,h  (t)):  t  £  T}.  If  P  is  closed,  then 
1  n 

T 

(1)  the  system  (h,(t),  ...  ,h  (t))  x  >  0  for  all  t  e  T  has  a 

1  n 

solution  if  and  only  if  the  origin  is  not  contained  in  conv(P), 
the  convex  hull  of  P; 

T 

(2)  the  system  (h  (t),  ...  ,h  (t))  x  >  0  for  all  t  e  T  has  a 

1  n  — 

non-trivial  (i.e.,  nonzero)  solution  if  and  only  if  the  origin  is 
not  contained  in  the  Interior  of  conv(P)  (Dines  and  McCoy  [7]).  0 

Lemma  1.  M  can  not  be  rescaled  positive  definite  if  and  only  if 
{x:  (D(u)Mu)Tx  >  0  for  all  u  £  S*1  * )  =  4> . 

Proof.  Let  T  =  {x:  (D(u)Mu)^x  >  0  for  all  u  £  s”  * } .  If  T  =  <t>, 

then  (ISLI)  has  no  solution.  By  Theorem  1,  M  can  not  be  rescaled 

positive  definite.  On  the  other  hand,  if  T  ^  let  x  e  T.  Then, 
uTD(x)Mu  =  (D(u)Mu)Tx  >  0  for  all  u  £  SD  *.  Hence,  D(x)M  is 
positive  definite  and  x  is  a  positive  vector  (assume  that  all 
diagonal  elements  of  M  are  positive).  □ 


Lemma  2.  M  can  not  be  rescaled  positive  definite  if  and  only  if  the 
origin  is  contained  in  conv(D(u)Mu:  u  e  S*1  *). 

Proof.  It  is  easy  to  show  that  {D(u)Mu:  u  £  Sn  ^ }  is  closed.  The 
lemma  then  follows  easily  from  the  Alternative  Theorem  and  Lemma  1.  □ 

Condition  2.  0  e  int{conv(D(u)Mu:  u  £  S°  *)} 

Leona  3.  Condition  1  and  Condition  2  are  equivalent. 

Proof.  Although  Conditions  1  and  2  look  different,  they  are  in  fact 

equivalent.  Indeed,  if  M  satisfies  Condition  2,  then  the  system 

T  T  n-1 

u  D(x)Mu  =  (D(u)Mu)  x  0  for  all  u  £  S  has  no  non-trivial 

solutions  (by  the  Alternative  Theorem).  This  implies  for  any 

p  1  T1 

0  t  d  >_  0,  there  exists  u  £  S  such  that  u  D(d)Mu  <  0,  i.e.,  M 
satisfies  Condition  1.  On  the  other  hand,  if  M  does  not  satisfy 

Condition  2,  then  (by  the  Alternative  Theorem)  there  exists  x  t  0 

T  T  1 

such  that  u  D(x)Mu  ■  (D(u)Mu)  x  ^  0  for  all  u  £  S  .  In  particular, 

IT-  i  - 

(e  )  D(x)Me  =  x^ra^  2.  0  for  aH  i  =  1,  ...  ,  n.  This  implies 
x^  >  0  for  all  i  =  1,  ...  ,  n  (assume  that  all  diagonal  elements  of 
M  are  positive).  Hence,  M  does  not  satisfy  Condition  1.  □ 


Remark  3.  Notice  that  G(x)  =  minimize  u  D(x)Mu  is  a  continuous 

_n- 1 
xcS 

function  of  x,  it  is  not  hard  to  show  the  following. 

(1)  M  can  be  rescaled  positive  definite  if  and  only  if 

T 

maximize  minimize  u  D(x)Mu  >  0. 
xeS"-*  u«Sn_* 

(2)  Condition  1  or  2  is  equivalent  to 

T 

Condition  3.  maximize  minimise  u  D(x)Mu  <0. 
xe  s”  uc  S 

We  summarize  all  nescssary  and  sufficient  conditions  for  M  to  be 
rescaled  positive  definite  in  Theorem  5. 


Theorem  5.  Suppose  that  all  diagonal  elements  of  M  are  positive. 
Then  the  following  are  equivalent: 

(1)  M  can  be  rescaled  positive  definite; 

(2)  (ISLI):  (D(u)Mu)Tx  1  for  all  u  e  Sn  *  has  a  solution; 

rp  1 

(3)  (D(u)Mu)  x  >  0  for  all  u  c  S  has  a  solution; 

(4)  the  origin  is  not  contained  in  conv(D(u)Mu:  u  e  Sn  ^); 

T 

(5)  maximize  minimize  u  D(x)Mu  >  0.  □ 

v, on- I  ,cn-I 
xe  u€  s 


Summary.  The  algorithm  solves  the  matrix  rescaling  problem  correctly 
and  completely.  It  is  finite  if  M  can  be  rescaled  positive  definite 
or  M  satisfies  Condition  1  (or  2,  3).  It  is  possibly  infinite  only  if 
M  can  not  be  rescaled  positive  definite  but  still  can  be  rescaled 
positive  semidefinite  (i.e.,  there  exists  0  ^  d  ^  0  such  that  D(d)M 
is  positive  semidefinite). 


Basis 

inverse 

yl 

y2 

y3 

IT  •  h  •  s  • 

1 

0 

0 

1 

0 

0 

1 

0 

1 

0 

0 

1 

0 

1 

0 

0 

1 

0 

0 

1 

1 

0 

0 

0 

1 

1 

1 

0 

Basis 

inverse 

1 

0 

0 

0 

1 

0 

0 

0 

1 

-1 

-1 

-1 

X 


(1  1  1) 


U1  =  (0  1  1)T 

B_1D(u1)Mu1  =  (0  -16  1)T 

Cj  =  1  -  x^D(u^)Mu^  =  16 


Tableau  of  (LP(1))  (k  =  1) 


Basis 

inverse 

*1 

y2 

y3 

y4 

r  *h«  s • 

1 

0 

0 

1 

0 

0 

0 

i 

0 

1 

0 

0 

1 

0 

-16 

i 

0 

0 

1 

0 

0 

1 

1 

i 

-1 

-1 

-1 

0 

0 

0 

16 

-3 

• 

• 

• 

* 

Basis 

inverse 

y2 

y2 

y3 

y4 

r.h.s. 

1 

0 

0 

1 

0 

0 

0 

1 

0 

1 

16 

0 

1 

16 

0 

17 

0 

0 

1 

0 

0 

1 

1 

1 

-1 

-1 

-17 

0 

0 

-16 

0 

-19 

• 

• 

17 


,*.*  k  *  »  »  »  i 


t  ff-  till  ■!  — 1\ 


=  (34.5  1  17 ) 1 
u3  =  (-1  -4  0)T 

B_1D(u3)Mu3  =  (-1.5  -77.5  -4.5)T 
c^  =  1  -  x3D(u3)Mu3  =  84.5 

- 1  3  3 

Since  B  D(u  )Mu  0  and  >  0,  we  know  that  v(LP(3))  =  °°. 
Therefore,  M  can  not  be  rescaled  positive  definite. 

Remark  5.  It  follows  easily  from  Facts  3  and  4  that  if  M  can  be 
rescaled  positive  definite,  then  M  is  a  P-matrix  (i.e.,  all  principal 
minors  of  M  are  positive).  The  above  3x3  matrix  is  a  P-matrix  but 
it  can  not  be  rescaled  positive  definite. 

Computational  Results. 

We  have  coded  the  algorithm  in  FORTRAN.  We  use  the  subroutine 
MINOS  (from  the  Systems  Optimization  Laboratory,  Department  of 
Operations  Research,  Stanford  University)  to  solve  (LP(k))  and  the 
subroutine  F02ABF  (from  NAG  Library,  Stanford  University)  to  calculate 
eigenvalues  and  eigenvectors.  The  data  were  randomly  generated  and  the 
program  was  executed  on  a  DEC  20  computer  with  the  following  results, 


see  Table  1 


Problem 

dimension 


number  of 
iterations 


CPU  time 
(second) 


3  > 

3 

5 

3.15 

5 

<  3 

14 

7.18 

6 

<  6 

9 

4.69 

8 

<  8 

9 

6.26 

16 

X  16 

8 

6.23 

5.  Accelerating  the  Convergence 

This  column  generating  algorithm  is  the  analogue  of  a  cutting 

plane  algorithm  applied  to  (ILP).  It  solves  the  infinite  linear 

program  (DILP)  by  generating  and  solving  a  sequence  of  linear  programs 

( LP( k)  ) ,  k  *  0,  1 .  If  the  algorithm  does  not  stop  at  iteration  k 

k+ 1  k+ 1 

then  a  new  column  D(u  )Mu  is  generated  and  brought  in.  This  is  a 
k+ 1  k+ 1  T 

cut,  (D(u  )Mu  )  x  ^  1,  on  (ILP).  If  we  want  to  accelerate  the 
convergence  of  the  algorithm,  we  have  to  find  ways  to  generate  more 
efficient  cuts. 

Let's  look  at  the  problem  geometrically.  Suppose  the  algorithm 

T  k 

does  not  stop  at  iteration  k.  Let  f^(u)  =  u  D(x  )Mu*  Then, 

i  k+1 

f^(u  )  >  0,  i  =  1,  ...  ,  k  and  f^(u  )  <  0.  Since  f^(u)  is  a 

continuous  function,  for  each  u*f  i  =  1,  ...  ,  k,  there  exists  a 

relatively  open  neighborhood  N^(u^)  sn  ^  such  that  f^(u)  >  0  for 

i  k+ 1  k  i 

all  u  e  N^(u  ).  f^(u  )  <  0  means  that  N^(u  ^  does  not 


£ 


cover  S  .  Suppose  M  can  be  rescaled  positive  definite  and  the 


algorithm  stops  at  iteration  k.  That  means  uk_^  N^(u^)  covers  Sn 


Therefore,  we  want  to  make  N^(u^)  bigger  so  that  we  need  fewer  N^(u^) 


to  cover  S°  ^  .  Let's  consider  the  cut  (D(uk  *  )Muk  *  )^x  >  ct  for  some 


a  >  1,  and  hope  that  it  will  give  a  bigger  N^+j(u1).  However,  since  we 


are  solving  linear  programs,  changing  all  the  cost  coefficients  to  a 


k+1 


will  result  in  a  solution  ax  and  therefore  has  no  influence  on 


k+2 


choosing  u  .  If  we  go  over  the  proofs  of  Theorems  1  and  2,  we  find 


that  if  we  change  (D(uk)Muk)^x  1  to  (D(uk)Muk)Tx  a^,  where 


0  <  6  a  <_  L  for  all  k,  then  Theorems  1  and  2  still  hold.  Since 


f,  (uk+1)  =  (l/2)uk+1[D(xk)M  +  MTD(xk)]uk+1 
k 


(l/2)\[D(xk)M  +  MTD(xk)], 


k+1. 


if  f,  (u  )  <  0,  a  natural  way  to  choose  a,  is: 
k  k+1 


a  =  -Of  (uk+1)  =  -9X  [D(xk)M  +  MTD(xk)], 
k+1  k  1 


k+1. 


where  0  is  a  positive  constant  (if  -0f^(u  )  <  6,  just  let 


Vi  *  6)- 


A  number  of  randomly  generated  problems  were  computed  using  the 


above  idea  (0  =  2)  and  compared  with  =  1 ,  see  Table  2. 


problem 

dimension 


5><5 


6  x  6 


8*8 


16  x  16 


no.  of  iterations 
(ct^  =  1  for  all  k) 

no.  of  iterations 
(“k  =  ~2fk(u  » 

14 

2 

9 

8 

9 

2 

8 

3 
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